Image capture system

ABSTRACT

An image capturing system includes a camera unit that captures an image of a cell; a display unit; an input unit that receives input from an operator regarding a selection operation on the cell; an analyzing unit that analyzes the image corresponding to the cell to which the selection operation is given and extracts a feature amount of the cell; and a specifying unit that specifies a recommended cell. The specifying unit sets a parameter that defines a range of the cell to be selected based on the feature amount of the cell to which the selection operation is given up to a first time point. In an image including the cell obtained by image capturing at a second time point later than the first time point, the specifying unit specifies the recommended cell on which the operator is prompted to make a selection based on the parameter.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims benefit of priority to International PatentApplication No. PCT/JP2018/044628, filed Dec. 4, 2018, and to JapanesePatent Application No. 2018-015169, filed Jan. 31, 2018, the entirecontents of each are incorporated herein by reference.

BACKGROUND Technical Field

The present disclosure relates to an image capturing system including animage capturing device that captures an image of a biological subjectsuch as, for example, cells or cell clusters.

Background Art

For example, in medical and biological research applications, imagecapturing for selecting cells or cell clusters (example of a biologicalsubject; sometimes simply referred to as “cell”) may be performed. Forexample, the work of capturing images of cells scattered on a platehaving many accommodating recesses with an image capturing device,selecting desired cells based on the obtained images, and sucking theselected cells with a tip and transferring the cells to a microplate maybe performed, as described, for example, in WO 2015/087371 A.

Examples of cell selecting methods include a method of depending on anoperator's manual selection and a method of setting in advance aselection reference value about the size, shape, and the like of a cell.The former method is a method of depending on skill of an individual bywhich the operator observes a captured image of the cell and makes aquality determination based on experience of the operator. The lattermethod is a method of determining a parameter related to the size andshape of a cell by image processing on the captured image of the cell,and automatically making a quality determination based on whether theparameter satisfies the selection reference value.

The method by the manual selection requires the operator to observeindividual cells to make a quality determination, and the work requiresa great deal of time. In addition, there is a problem that the qualitydetermination of cells is likely to vary depending on the subjectivityof each individual, the degree of experience, and the like, and it isdifficult to obtain uniform quality determination results. In contrast,the method of setting in advance the selection reference value allowsautomatic determination of quality of cells, reducing the labor.However, there is a problem that it is necessary to consider variousparameters in order to prepare an optimum selection reference value inadvance, and it is very difficult to set such a selection referencevalue.

SUMMARY

Accordingly, the present disclosure provides an image capturing systemthat can accurately select a biological subject and reduce the labor ofwork for selecting the biological subject.

An image capturing system according to one aspect of the presentdisclosure includes an image capturing device configured tosimultaneously capture an image of a plurality of biological subjects; adisplay unit configured to display the image including the plurality ofbiological subjects captured by the image capturing device; an inputunit configured to receive input from an operator regarding a selectionoperation on the plurality of biological subjects displayed on thedisplay unit; an analyzing unit configured to analyze the imagecorresponding to each of the biological subjects to which the selectionoperation is given by the input unit and extract a feature amount aboutthe biological subject; and a specifying unit configured to set aparameter that defines a range of each of the biological subjects to beselected based on the feature amount extracted by the analyzing unit foreach of the biological subjects to which the selection operation isgiven up to a first time point or a reference feature amount determinedin advance, the specifying unit being configured to configured tospecify a recommended biological subject on which the operator isprompted to make a selection based on the parameter in the imageincluding the plurality of biological subjects obtained by imagecapturing at a second time point later than the first time point.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram schematically showing a configuration example of acell transfer device to which an image capturing system according to anembodiment of the present disclosure is applied;

FIG. 2A is a top view of a dish included in a selection container usedin the cell transfer device, and FIG. 2B is a cross-sectional view takenalong line IIB-IIB of FIG. 2A;

FIG. 3 is a diagram schematically showing a flow of cell selecting workusing the image capturing system according to the present embodiment;

FIG. 4A is a diagram showing one example of a shape of a cell, and FIG.4B is a graph for describing one example of selection criteria based onthe shape of a cell;

FIG. 5 is a diagram for describing selection criteria based on a hue ofa cell;

FIG. 6 is a diagram for describing selection criteria based on a patternof a cell;

FIGS. 7A and 7B are diagrams for describing selection criteria based onlight intensity of a cell;

FIG. 8 is a block diagram of the image capturing system according to theembodiment of the present disclosure; and

FIG. 9 is a flowchart of a cell selecting operation using the imagecapturing system.

DETAILED DESCRIPTION

An embodiment of the present disclosure will be described in detailbelow with reference to the drawings. An image capturing systemaccording to the present disclosure can capture images of a wide varietyof biological subjects. In the present disclosure, as the biologicalsubject to be captured, a cell of biological origin can be typicallyillustrated. Examples of the cell of biological origin here include asingle cell (cell) such as a blood cell and single cell, tissue fragmentsuch as Histoculture and CTOS, cell aggregation cluster such asspheroids and organoids, individuals such as zebrafish, nematodes,fertilized eggs, and 2D or 3D colony. In addition, tissues,microorganisms, small species, and the like can be illustrated as thebiological subject. The embodiment described below shows an example inwhich the biological subject is cells or a cell aggregation clusterformed by aggregating several to several hundred thousand cells(hereinafter, collectively referred to simply as “cell C”).

[Overall Structure of Cell Transfer Device]

FIG. 1 is a diagram schematically showing an overall configuration of acell transfer device S to which an image capturing system according toan embodiment of the present disclosure is applied. Here, the celltransfer device S that transfers a cell C between two containers (dish 2and microplate 4) is illustrated.

The cell transfer device S includes a translucent base 1 having ahorizontal mounting surface (upper surface), a camera unit 5 (imagecapturing device) placed below the base 1, and a head unit 6 placedabove the base 1. A selection container 11 including the dish 2 (plate)is mounted at a first mounting position P1 of the base 1, and themicroplate 4 is mounted at a second mounting position P2. The head unit6 includes a plurality of heads 61 to which tips 12 that each suck anddischarge the cell C are attached, the heads 61 capable of moving in a Zdirection (up-and-down direction). The camera unit 5 and the head unit 6are movable in the X direction (horizontal direction) and the directionperpendicular to the plane of FIG. 1 (Y direction). The dish 2 and themicroplate 4 are mounted on an upper surface of the base 1 within amovable range of the head unit 6.

Roughly, the cell transfer device S is a device in which each of theplurality of tips 12 sucks the cell C individually from the dish 2 ofthe selection container 11 holding a large number of cells C, andtransfers the cell C to the microplate 4, and the plurality of tips 12simultaneously discharges the cells C to the microplate 4 (well 41).Before the suction of the cells C, the cells C held in the dish 2 arecaptured by the camera unit 5, and selection work for selecting goodquality cells C to be transferred to the microplate 4 is performed.

Each part of the cell transfer device S will be described below. Thebase 1 is a rectangular flat plate having predetermined rigidity, andpart or all of which is formed of a translucent material. The preferredbase 1 is a glass plate. The base 1 is formed of a translucent materialsuch as a glass plate, thereby allowing the camera unit 5 placed belowthe base 1 to capture the selection container 11 (dish 2) and themicroplate 4 placed on an upper surface of the base 1 through the base1.

The selection container 11 is a container that is a transfer source ofthe cells C, stores a culture medium L, and holds the dish 2 for cellselection in a state of being immersed in the culture medium L. The dish2 is a plate that holds the cells C, and has a plurality of holdingrecesses 3 (compartments that accommodate subjects) that canindividually accommodate and hold the cells C on an upper surface. Theculture medium L is not particularly limited as long as the culturemedium L does not deteriorate the properties of the cells C, and can beappropriately selected depending on the type of cell C.

The selection container 11 includes a rectangular upper opening 11H onthe upper surface side. The upper opening 11H is an opening forinjecting the cells C and picking up the selected cells C. The dish 2 isplaced below the upper opening 11H. The selection container 11 and thedish 2 made of a translucent resin material or glass is used. This is toallow the camera unit 5 placed below the selection container 11 toobserve the cells C supported in the dish 2.

A plurality of cells C dispersed in a cell culture solution is injectedinto the selection container 11 from a dispensing tip (not shown). Thedispensing tip sucks the cell culture solution together with the cells Cfrom a container that stores the cell culture solution containing thelarge amount of cells C, and holds the cell culture solution in thedispensing tip. Thereafter, the dispensing tip is moved to an upper airposition of the selection container 11 to access the upper surface ofthe dish 2 through the upper opening 11H. Then, with a tip opening ofthe dispensing tip immersed in the culture medium L of the selectioncontainer 11, the cells C held in the dispensing tip are discharged ontothe dish 2 together with the cell culture solution.

The microplate 4 is a container serving as a transfer destination forthe cells C, and includes a plurality of wells 41 in which the cells Care discharged. The wells 41 are each a bottomed hole opened on an uppersurface of the microplate 4. One well 41 accommodates a required numberof (usually one) cells C together with the culture medium L. Themicroplate 4 made of a translucent resin material or glass is used. Thisis to allow the camera unit 5 placed below the microplate 4 to observethe cells C supported in the well 41.

The camera unit 5 captures an image of the cells C held in the selectioncontainer 11 or the microplate 4 from the lower surface side thereof,and includes a lens unit 51 and a camera body 52. The lens unit 51 is anobject lens used in an optical microscope, and includes a lens groupthat forms a light image with a predetermined magnification and a lensbarrel that accommodates the lens group. The camera body 52 includes animage capturing element such as a CCD image sensor. The lens unit 51forms a light image of an image capturing target on a light receivingsurface of the image capturing element. The camera unit 5 is movable inthe X and Y directions below the base 1 along a guide rail 5G extendingin the left-right direction parallel to the base 1. In addition, thelens unit 51 is movable in the Z direction for a focusing operation.

The head unit 6 is provided for picking up the cells C from the dish 2and transferring the cells C to the microplate 4, and includes theplurality of heads 61 and a head body 62 to which the heads 61 areassembled. At the tip of each head 61, the tip 12 that sucks (pickup)and discharges the cells C is attached. The head body 62 holds the heads61 so as to be raised and lowered in the +Z and −Z directions, and ismovable in the +X and −X directions along a guide rail 6G. Note that thehead body 62 is also movable in the Y direction.

[Details of Dish]

Detailed structure of the dish 2 will be described. FIG. 2A is a topview of the dish 2, and FIG. 2B is a cross-sectional view taken alongline IIB-IIB of FIG. 2A. The dish 2 includes a dish body 20 and aplurality of holding recesses 3 formed in the dish body 20. The dishbody 20 includes a flat plate-shaped member having a predeterminedthickness and includes an upper surface 21 and a lower surface 22. Eachholding recess 3 includes a cell C receiving opening (opening portion31) on the upper surface 21 side. The dish 2 is immersed in the culturemedium L in the selection container 11. In detail, the dish 2 is held inthe selection container 11 with a space between the lower surface 22 anda bottom plate of the selection container 11 while the upper surface 21of the dish body 20 is immersed in the culture medium L in the selectioncontainer 11 (see FIG. 1).

Each of the holding recesses 3 includes an opening portion 31, a bottomportion 32, a cylindrical wall surface 33, a hole portion 34, and aboundary portion 35. The present embodiment shows an example in whichthe holding recesses 3 that are square in top view are arranged in amatrix. As shown in FIG. 2B, the plurality of holding recesses 3 isarranged in a matrix at a predetermined recess arrangement pitch.

The opening portion 31 is a square opening provided on the upper surface21, and has a size that allows entrance of a tip opening portion t ofthe tip 12 for selection. The bottom portion 32 is positioned inside thedish body 20 and near the lower surface 22. The bottom portion 32 is aninclined surface that gently inclines downward toward the center (centerof the square). The cylindrical wall surface 33 is a wall surfaceextending vertically downward from the opening portion 31 toward thebottom portion 32. The hole portion 34 is a through hole verticallypenetrating between the center of the bottom portion 32 and the lowersurface 22. The boundary portion 35 is a portion that is positioned onthe upper surface 21 and serves as an opening edge of each holdingrecess 3, and is a ridge line that partitions the holding recesses 3from each other.

The bottom portion 32 and the cylindrical wall surface 33 of eachholding recess 3 define an accommodation space 3H that accommodates thecell C. It is generally intended that one cell C is accommodated in theaccommodation space 3H. The hole portion 34 is provided to allow a smallcell or impurities having a size other than a desired size to escapefrom the accommodation space 3H. Therefore, the size of the hole portion34 is selected such that the cell C having the desired size cannot passthrough but a small cell and impurities other than the desired size canpass through. Accordingly, the cell C to be selected is trapped in theholding recess 3, while impurities and the like fall from the holeportion 34 to the bottom plate of the selection container 11.

[Flow of Cell Selecting Work]

Subsequently, an overall flow of the selecting work of the cells C usingthe image capturing system of the present embodiment will be described.FIG. 3 is a diagram schematically showing procedures (A) to (G) of thecell selecting work using the image capturing system according to thepresent embodiment. In the first procedure (A), the camera unit 5captures an image of the dish 2 to acquire an image of the cells Csupported in the dish 2. The lens unit 51 of the camera unit 5 has anangle of view that can simultaneously capture an image of a plurality ofcells C (biological subjects). That is, the lens unit 51 has an angle ofview that can capture the plurality of holding recesses 3 of the dish 2shown in FIG. 2 by one image capturing operation.

The procedure (A) shows an example in which an image of the holdingrecesses 3 of a 3×3 (m1 to m3×n1 to n3) matrix is captured by one imagecapturing operation. The example here shows a state in which onerelatively small cell C is held in each of the holding recesses 3 ofm1n2 and m1n3, one relatively large cell C is held in the holding recess3 of m2n3, two cells C are held in each of the holding recesses 3 ofm2n2, m3n1, and m3n3, and no cell C is held in other holding recesses 3.

In the subsequent procedure (B), a feature amount of the cell C held ineach holding recess 3 is extracted by analyzing the image acquired inthe procedure (A). As will be described later, examples of the featureamount include an amount of cell C obtained from the number, area,estimated volume, and the like of the cell C, color and pattern of thecell C, and light intensity when the cell C is fluorescent. Analysisresults of the cell C in each holding recess 3 are digitized.

In the next procedure (C), the analysis results obtained in theprocedure (B) are compared with a parameter defining the range of thecell C to be selected. The parameter is a parameter indicating the rangeof the feature amount of the cell C that is preferable as a selectiontarget. The parameter is obtained from past analysis results of the cellC based on images obtained by image capturing until this time andselection results (selection operation up to a first time point). Theparameter is, so to speak, a learning value of the selection criterionin the current situation. Note that in a case of initial selectionprocessing or the like, if the learning value of the selection criteriondoes not yet exist, a parameter set based on a reference feature amountdetermined in advance as the cell C preferable for selection is comparedwith the analysis result obtained in the procedure (B).

In the subsequent procedure (D), a recommended cell C (recommendedbiological subject) on which the operator is prompted to make aselection as a transfer target is specified based on the comparisonresult of the procedure (C). The recommended cell C is specifieddepending on whether the feature amount of each cell C contained in theimage obtained by the image capturing this time (image capturing at asecond time point later than the first time point) belongs to the rangeof the parameter. Then, the recommended cell C is displayed to theoperator on a display unit such as a monitor. The illustrated procedure(D) shows an example in which the cells C supported in the holdingrecesses 3 of m1n2 and m1n3 (recommended cells C) are recommended to theoperator. A display for causing the operator to recognize that selectionis prompted is added to the recommended cell C (enclosing the cell Cwith a high-luminance marker, adding a symbol or the like as a mark, orthe like).

Subsequently, in the procedure (E), approval work of the recommendedcell C is performed by a manual operation of the operator. This approvalwork is work for the operator to determine whether the recommended cellC presented from the image capturing system side in the procedure (D)may be actually treated as the cell C to be selected as the transfertarget in light of the operator's own experience. Here, the cells C ofm1n2 and m1n3 correspond to the recommended cell C. When the operatordetermines that these cells C are the cell to be selected for transfer,the operator performs an approval operation. When the operatordetermines that these cells C are not to be selected, the operatorperforms a disapproval operation.

Also, in the procedure (E), it is determined whether a cell C thatshould be treated as the selected cell C exists among the cells C thatare not treated as the recommended cell C in the procedure (D) by theimage capturing system side. Specifically, the operator determineswhether there is a cell C to be transferred among the cells of m2n2,m2n3, m3n1, and m3n3 that are not the recommended cell C. When such acell C exists, the operator additionally performs the operation ofselecting the cell C. The illustrated procedure (E) shows an example inwhich the recommended cells C of m1n2 and m1n3 are approved, and thecell C of m2n3 is additionally selected (additionally approved).

In the subsequent procedure (F), the parameter (learning value) thatdefines the range of the cell C to be selected is updated based on theoperator's approval and a result of the additional selection. In theprocedure (E), the recommended cell C presented is approved, but thecell C of m2n3 is additionally selected. That is, the recommended cell Cpresented by the image capturing system does not agree with the cell Cactually selected by the operator. In this case, with reference to theanalysis result (feature amount) derived in the procedure (B) on theactually selected cell C, the parameter (learning value) is correctedsuch that those cells C fall within a category of “cell to be selected”.Then, when operations of the procedures (A) to (E) are performed againon each cell C included in the image obtained by the next imagecapturing (image capturing at a third time point later than the secondtime point), the recommended cell C is specified based on the correctedparameter.

In the post-process of the procedure (G) to be executed after theprocedure (F), predetermined work is performed on the cell C approvedand additionally approved by the operator (procedure (G-a)).Alternatively, predetermined work is performed on the cell C that hasnot been approved (procedure (G-b)). A typical example of thepredetermined work is pickup and transfer of the cell C. In theprocedure (G-a), the cells C of m1n2, m1n3, and m2n3 (cells C to whichthe selection operation is given) are picked up. Meanwhile, when theprocedure (G-b) is performed, the work for picking up the cells Cexisting in the holding recesses 3 other than mln2, mln3, and m2n3, orthe additional work on the cell C is performed.

[Example of Extracting Feature Amount of Cell]

Subsequently, a specific example of extracting the feature amount of acell C from an image will be described. In the present embodiment, animage of cells is captured in a state where the cells are accommodatedin the holding recesses 3 of the dish 2 (compartments of the plate), theimage obtained by the image capturing is analyzed, and the featureamount of the cell C is extracted in units of individual holding recess3. Such a feature amount that easily appears in the image is the shapeof the cell C or the amount of the cell C accommodated in one holdingrecess 3.

The shape of the cell C can be evaluated by roundness of the cell C asshown in FIG. 4A, for example That is, the shape of the cell C can beevaluated by digitizing to what extent the shape of the outer contour ofthe cell C specified from a two-dimensional image is close to theperfect circle R. The amount of cell C can be evaluated from, forexample, the number of cells C accommodated in one holding recess 3, thearea of the cell C on the two-dimensional image, estimated volume of thecell C estimated from the contour of the cell C on the two-dimensionalimage, and the like.

FIG. 4B shows an example in which the shape (roundness) of the cell Cand the area of the cell C are extracted as the feature amount, and therecommended cell C is specified from combination of the shape and thearea of the cell C. The roundness of the cell C often affects thesoundness of the cell C. The area of the cell C is an indicator thatdirectly indicates the size of the cell C. Therefore, the recommendedcell C can be specified by performing the process of recommending (OK)the cell C1 whose roundness and area are within a certain range(triangular region indicated by symbol a in the figure; this isdetermined by the learning value), and not recommending (NG) the cell C2outside the region a.

The number of cells C is an indicator that is OK when one cell C isaccommodated in one holding recess 3 and is NG when a plurality of cellsC is accommodated. If a plurality of cells C are accommodated in oneholding recess 3, the cells C will be observed in a two-dimensionalimage in which the cells C are superimposed, making it difficult toperform evaluation itself of each individual cell C. That is, it can besaid that the number of cells C is an indicator of whether to avoidextraction of the feature amount because an accurate analysis resultcannot be obtained, rather than the property of the cells C themselves.

The estimated volume of the cell C is also an indicator indicating thesize of the cell C. The estimated volume may be obtained, for example,by estimating the three-dimensional shape of the cell C from the contourof the cell C shown in one two-dimensional image. The estimated volumemay be obtained by estimating the three-dimensional shape of eachcontour of the cell C that appears in a plurality of two-dimensionalimages obtained by changing the focal position for the cell C in the Zdirection.

The feature amount of the cell C can be a feature amount based on thecolor of the cell C. The hue of the cell C often reflects the health orlife and death of the cell C. FIG. 5 is a diagram for describingselection criteria based on the hue of the cell C. For example, assumingthat there are samples a, b, and c of cells C with different hues, thecell C may be evaluated by the hue, such as the sample a is a healthycell C, the sample b is a living but unhealthy cell C, and the sample cis a dead cell C. In this case, it is possible to specify therecommended cell C by extracting, for example, average luminance of thecells C as the feature amount from the captured image and using theappropriate average luminance between the samples a and b (which isdetermined by the learning value) as a selection threshold.

The feature amount of the cell C can be a feature amount based on thepattern of the cell C. The pattern of the cell C that appears on thecaptured image may represent the type of cell C. FIG. 6 showsphotographs of different types of cancer cell-1, cancer cell-2, andcancer cell-3. The cancer cell-1 indicates a colon cancer, the cancercell-2 indicates an endometrial cancer, and the cancer cell-3 indicatesa lung cancer. In this way, the pattern of the cell C observed on animage differs depending on the type of cancer cell. Therefore, bylinearizing and quantifying the pattern, the pattern can be digitized asthe feature amount. Then, the recommended cell C can be specified bysetting an appropriate parameter (this is determined by the learningvalue) that distinguishes the feature amount based on the pattern of thecell C to be selected from the feature amount based on the pattern ofanother cell C.

Furthermore, the feature amount of the cell C can be a feature amountbased on light intensity of the region of the cell C on the image. Theintensity of light emitted by the cell C, particularly the intensity oflight emitted by the cell C when the cell C becomes fluorescent byreacting with an appropriate reagent, may be a criterion for evaluatingthe soundness of the cell C. Therefore, as illustrated in FIG. 7A, thedifference between the average luminance α (light intensity) of theperipheral region AC (generally culture medium) of the cell C on theimage and the average luminance β of the cell C can be used as adigitized feature amount. Then, the recommended cell C can be specifiedby using appropriate average luminance between the average luminance αand the average luminance β (which is determined by the learning value)as the selection threshold. Note that as shown in FIG. 7B, it can bedetermined whether the cell C satisfying predetermined average luminanceexists in the image by dividing the cell C and the peripheral region ACthereof into a plurality of blocks BL on the image, calculating theaverage luminance in each block BL, and confirming that a place existswhere the average luminance varies significantly.

[Configuration of Image Capturing System]

FIG. 8 is a block diagram of the image capturing system according to theembodiment of the present disclosure. The image capturing systemincludes the camera unit 5 that captures the image capturing target onan image capturing optical axis, a control unit 7 that controls anoperation of the lens unit 51 and performs predetermined processingbased on image information acquired by the camera body 52, a lensdriving motor 53 that moves the lens unit 51 up and down, a display unit74, and an input unit 75. FIG. 8 shows the dish 2 accommodated in theselection container 11 as the image capturing target. Note that thecontrol unit 7 also controls the pickup operation and transfer operationof the cell C by controlling a head motor 63 in the head unit 6 and anaxial motor 64.

The lens driving motor 53 rotates forward or backward to move the lensunit 51 in an up-and-down direction with a predetermined resolution viaa power transmission mechanism (not shown). By this movement, the focusposition of the lens unit 51 is adjusted to the cells C supported in thedish 2. Note that as shown by the dotted line in FIG. 8, the selectioncontainer 11 itself or the stage on which the selection container 11 ismounted (base 1) may be moved up and down, not by the lens unit 51 butby another motor that substitutes the lens driving motor 53.

The head motor 63 is a motor that serves as a drive source for theascent and descent operation of the heads 61 with respect to the headbody 62, and for the operation of generating suction force and dischargeforce at the tip opening portion t of the tips 12 attached to the head61. The axial motor 64 is a motor that serves as a drive source formoving the head unit 6 (head body 62) along the guide rail 6G (FIG. 1).

The control unit 7 includes, for example, a personal computer or thelike, and operates to functionally include a drive control unit 71, animage processing unit 72, and an arithmetic unit 73 by executing apredetermined program.

The drive control unit 71 controls operations of the lens driving motor53, the head motor 63, and the axial motor 64. Specifically, the drivecontrol unit 71 gives control pulses for moving the lens unit 51 in anup-and-down direction at a predetermined pitch (for example, tens of μmpitch) to the lens driving motor 53 for the focusing operation. Also,although not shown in FIG. 8, the drive control unit 71 also controls anoperation of a camera axis drive motor that moves the camera unit 5along the guide rail 5G. Furthermore, the drive control unit 71 alsocontrols mechanical operations of the head unit 6. The drive controlunit 71 controls the head motor 63 to control the raising and loweringoperation of the heads 61 and the operation of generating suction forceor discharge force at the tip opening portion t of the tips 12.

The image processing unit 72 performs image processing such as edgedetection processing and pattern recognition processing with featureamount extraction on image data acquired by the camera body 52. Theimage processing unit 72 acquires the image data of the dish 2supporting the cells C and recognizes the cells C existing on the dish 2(holding recesses 3) by the image processing.

The arithmetic unit 73 mainly performs various analyses on the cell C onthe image specified by the image processing unit 72, and also performsprocessing of specifying the recommended cell C to be presented to theoperator. The arithmetic unit 73 functionally includes an analyzing unit731, a specifying unit 732, and a mode changing unit 733.

The analyzing unit 731 performs processing of extracting the featureamount of the cell C by analyzing the image of the cell C. The featureamount to be extracted includes the shape, number, area, estimatedvolume, color, pattern, light intensity, or the like of the cell C asdescribed above with reference to FIGS. 4 to 7. The analyzing unit 731digitizes these feature amounts.

As described above with reference to FIG. 3, the specifying unit 732performs processing of specifying the recommended cell C to be presentedto the operator by comparing the parameter derived based on theoperator's past cell selection record with the feature amount extractedby the analyzing unit 731 about the cell C included in the imageacquired by the image capturing this time. The specifying unit 732 setsthe parameter that defines the range of the cell C to be selected basedon the feature amount extracted by the analyzing unit 731 about the cellC selected by the operator up to the specified first time point. Thisparameter is the learning value of the cell C selection criterion at thefirst time point. Then, in the image including the cell C obtained bythe image capturing at the second time point later than the first timepoint, the specifying unit 732 specifies the recommended cell C on whichthe operator is prompted to make a selection based on the parameter.That is, among the cells C included in the image acquired at the secondtime point, the cell C having the feature amount belonging to the rangeof the parameter is specified as the recommended cell C.

Furthermore, as described in the procedures (E) and (F) of FIG. 3, inthe selection operation of the cell C in the image obtained by the imagecapturing at the second time point, when a cell C that does not agreewith the recommended cell C specified earlier is selected, thespecifying unit 732 corrects the parameter based on the feature amountof the selected cell C. That is, the learning value of the selectioncriterion of the cell C at the first time point is updated. Then, in theimage of the cell C obtained by image capturing at the third time pointlater than the second time point, the specifying unit 732 performsprocessing of specifying the recommended cell C based on the updatedparameter.

The mode changing unit 733 performs processing of changing an operationmode between a manual operation mode of receiving an approval operationof the operator about the recommended cell C and an automatic approvalmode of automatically approving the recommended cell C. In other words,the manual operation mode is to sequentially update the parameter(learning value) according to the selection result of the operator asdescribed above. Meanwhile, without performing such update and withoutreceiving the selection operation from the operator, the automaticapproval mode treats the recommended cell C specified by the specifyingunit 732 as the cell C for which the selection operation is received. Itis assumed that, as the learning of the parameter progresses, theaccuracy of specifying the recommended cell C increases to such anextent that intervention of the operator's selection operation is nolonger required. At such timing, the mode changing unit 733 changes theoperation mode from the manual operation mode to the automatic approvalmode. This makes it possible to completely automate the cell C selectionwork.

The display unit 74 is a display that displays images captured by thecamera unit 5. In the present embodiment, the display unit 74 displaysthe image of the dish 2 captured by the camera unit 5, that is, theimage including the plurality of cells C supported in the plurality ofholding recesses 3. In addition, a predetermined display that can beeasily identified by the operator is added to the recommended cell C.

The input unit 75 includes a keyboard, a mouse, or the like, andreceives input from the operator regarding the selection (approval)operation for the cell C displayed on the display unit 74. Theoperator's approval operation and additional approval operationdescribed in the procedure (E) of FIG. 3 are received by the input unit75.

[Flow of Cell Selecting Operation]

Subsequently, the cell selecting operation using the image capturingsystem of the present embodiment shown in FIG. 8 will be described withreference to the flowchart shown in FIG. 9. When the process starts, thecamera unit 5 captures an image of the dish 2. A cell suspension hasbeen dispensed in the dish 2 in advance. The camera unit 5 captures animage of the cells C accommodated in the holding recesses 3 of the dish2 (step S1/image capturing at the first time point). At this time, thedrive control unit 71 drives the lens unit 51 to perform the focusingoperation on the cells C on the dish 2. The captured image is displayedon the display unit 74 as shown in the procedure (A) in FIG. 3, forexample.

Next, the input unit 75 receives input of the first selection operationfrom the operator regarding which of the cells C displayed on thedisplay unit 74 is to be transferred (step S2). At this time point,there is no parameter (learning value) that defines the range of thecell C to be selected. Note that in step S2, the selection operation ofthe operator may be received after specifying the recommended cell Cbased on a setting value set in advance and displaying the recommendedcell C on the display unit 74 in a visually recognizable manner.

Subsequently, the image processing unit 72 performs image processing ofacquiring image data of the dish 2 supporting the cells C from thecamera body 52, and specifying the cells C included in the image. Theimage processing data is sent to the analyzing unit 731 of thearithmetic unit 73. The analyzing unit 731 performs processing ofdetermining the feature amount such as the shape, number, area,estimated volume, color, pattern, light intensity, and the like of thecell C selected by the operator and other cells C (step S3).

Then, with reference to the feature amount of the cell C selected by theoperator among the feature amounts of respective cells C obtained by theanalyzing unit 731, the specifying unit 732 determines the parameterthat defines the range of the cell C to be selected. That is, theselection criterion of the cell C is learned (step S4). For example,when the area is selected as the feature amount, the parameter is alower limit area threshold and an upper limit area threshold of the cellC preferable as the transfer target. When the color is selected as thefeature amount, the parameter is lower limit average luminance thresholdand upper limit average luminance threshold. Such a parameter is storedin a memory region (not shown) included in the control unit 7 (step S5).

Here, it is confirmed whether the operation mode has been changed by themode changing unit 733 from the manual operation mode to the automaticapproval mode (step S6). When the learning of the parameter isinsufficient, the default manual operation mode is maintained (YES instep S6). Meanwhile, when the learning of the parameter is sufficientlyadvanced, for example, when the parameter stored in step S5 has reacheda state where there is almost no variation in the latest plurality ofupdates, the operation mode is changed from the manual operation mode tothe automatic approval mode (NO in step S6).

When the manual operation mode is maintained (YES in step S6), the imageof the cell C supported on the dish 2 is again captured by the cameraunit 5 (step S7/image capturing at the second time point). The imagedata obtained by this image capturing is subjected to the processing ofspecifying the cell C by the image processing unit 72 and the processingof extracting the feature amount of each cell C by the analyzing unit731. Then, with reference to the current parameter (learning value), thespecifying unit 732 specifies the recommended cell C on which theoperator is prompted to make a selection among the cells C included inthe captured image this time. Then, as shown in the procedure (D) ofFIG. 3, the recommended cell C is displayed on the display unit 74 in avisually recognizable manner to the operator (step S8).

Subsequently, similarly to step S2, the input unit 75 receives input ofthe selection operation from the operator regarding which of the cells Cdisplayed on the display unit 74 is to be transferred (step S9).Thereafter, the process returns to step S3, and the analyzing unit 731specifies the feature amount of the cells C selected by the operator instep S9. Then, with reference to the feature amount of these cells C,the specifying unit 732 determines the parameter of the selectioncriterion of the cell C (step S4). At this time, if there is adiscrepancy between the recommended cell C presented by the specifyingunit 732 in the previous step S8 and the cell C actually selected by theoperator in step S9, the parameter will be updated with a new value. Inthe image obtained by the next image capturing of the cell C (stepS7/image capturing at the third time point), the recommended cell C isspecified based on the updated parameter.

On the other hand, when the mode changing unit 733 changes the operationmode to the automatic approval mode (NO in step S6), the operator'sselection operation is omitted thereafter. The image of the cells Csupported on the dish 2 is captured by the camera unit 5 (step S10).Subsequently, the specifying unit 732 performs processing of specifyingthe recommended cell C among the cells C included in the obtained image(step S11). Then, the recommended cell C specified in step S11 isautomatically selected as the transfer target cell C without receivingthe operator's selection operation from the input unit 75 (step S12).

Thereafter, it is confirmed whether the image capturing of the cell C iscontinued (step S13). When the image capturing is continued (YES in stepS13), returning to step S10, the camera unit 5 performs the next imagecapturing operation on the dish 2. On the other hand, when there is nocell C to be captured (NO in step S13), the process ends.

[Operational Effects]

With the image capturing system according to the present embodimentdescribed above, in the selection operation on the cell C performed atthe second time point or thereafter, the recommended cell C is presentedto the operator on the display unit 74. This allows the operator toquickly select the cell C while referring to the recommended cell C.Moreover, the recommended cell C is highly accurate because therecommended cell C is specified based on the parameter which is based onselection records of the operator up to the first time point. Therefore,the operator can select the cell C accurately and can reduce the laborof the operator in the work of selecting the cell C.

If there is a discrepancy between the recommended cell C and the cell Cactually selected by the operator at the second time point, thespecifying unit 732 extracts the feature amount again (learns thefeature amount), and the parameter serving as the selection criterion ofthe cell C is corrected based on the feature amount. Then, at the thirdtime point, the recommended cell C is specified based on the correctedparameter. Therefore, in the selection operation at the third time pointand thereafter, the accuracy of specifying the recommended cell C can befurther improved. That is, in parallel with the operator's selectionoperation, the accuracy of specifying the recommended cell C can begradually improved based on the learning effect of the feature amount.

Furthermore, the image capturing system of the present embodiment has aconfiguration in which the specifying unit 732 learns the feature amountbased on the selection result of the operator. Therefore, when aplurality of operators are present, the specifying unit 732 canindividually learn the feature amount according to the selection resultof each operator. In this case, for example, when performing theselection operation from the input unit 75, the operation is received inassociation with the identification ID of the operator, and the learningdata is generated for each operator and stored in a memory region of thearithmetic unit 73. This makes it possible to specify the individualrecommended cell C based on selection tendency of each operator, ratherthan the average recommended cell C for all the operators.

Furthermore, the image capturing system of the present embodiment cancause the specifying unit 732 to learn the feature amount for each typeor each individual of the biological subject, and cause the specifyingunit 732 to specify the recommended cell C for each type or individual.For example, when different types of cancer cell such as, for example, apancreatic cancer cell and an ovarian cancer cell are to be captured asthe biological subject, a cancer cell classification determined inadvance or the like is input before the selection operation of the cellC from the input unit 75 is performed. Then, the learning data isgenerated for each type of cancer cell according to the selection resultof the operator, and is stored in a memory region of the arithmetic unit73. This allows the specifying unit 732 to specify the recommended cellC according to the type of cancer cell.

Furthermore, for example, even for the same cancer cell, a test subjectA and a test subject B different from each other may have differenttendencies of cell necessary for experiments, tests, and the like. Thatis, the recommended cell C may differ depending on the individual evenfor the same cell type. The same applies when the recommended cell C isspecified for each individual. In this case, before the selectionoperation of the cell C from the input unit 75 is performed, theidentification ID and the like of the individual from whom the cell C iscollected is input. Then, according to the selection result of theoperator, the learning data is generated for each individual and storedin a memory region of the arithmetic unit 73. This allows the specifyingunit 732 to specify the recommended cell C according to each individual.

In actual operations, if it is desired to specify the recommended cell Cin units of individual and type, for example, if it is desired tospecify the recommended cell C in units of “pancreatic cancer cell” of“test subject A”, the ID or the like is input from the input unit 75 sothat such individual and type classification can be performed.Meanwhile, if it is sufficient to perform classification by the unit of“pancreatic cancer cell”, the ID related to the type or the like isinput from the input unit 75. This makes it possible to generate thelearning data in a required unit and to cause the specifying unit 732 tospecify the recommended cell C suitable for the unit.

[Configurations Included in the Above Embodiment]

Note that the above-described specific embodiment mainly includes thefollowing configurations.

An image capturing system according to one aspect of the presentdisclosure includes an image capturing device configured tosimultaneously capture an image of a plurality of biological subjects; adisplay unit configured to display the image including the plurality ofbiological subjects captured by the image capturing device; an inputunit configured to receive input from an operator regarding a selectionoperation on the plurality of biological subjects displayed on thedisplay unit; an analyzing unit configured to analyze the imagecorresponding to each of the biological subjects to which the selectionoperation is given by the input unit and extract a feature amount aboutthe biological subject; and an identifying unit configured to set aparameter that defines a range of each of the biological subjects to beselected based on the feature amount extracted by the analyzing unit foreach of the biological subjects to which the selection operation isgiven by a first time point or a reference feature amount determined inadvance, the identifying unit being configured to identify a recommendedbiological subject on which the operator is urged to make a selectionbased on the parameter in the image including the plurality ofbiological subjects obtained by image capturing at a second time pointlater than the first time point.

With this image capturing system, in the selection operation by theinput unit performed at the second time point or thereafter, therecommended biological subject is presented to the operator. This allowsthe operator to quickly select the biological subject while referring tothe recommended biological subject. Moreover, the recommended biologicalsubject is highly accurate because the recommended biological subject isspecified based on the parameter which is based on selection records ofthe operator up to the first time point or the reference feature amount.Therefore, the image capturing system can accurately select thebiological subject and reduce the labor of work for selecting thebiological subject.

In the image capturing system, preferably, when the input unit receivesinput of the selection operation of each of the biological subjects thatdoes not agree with the recommended biological subject specified by thespecifying unit in the selection operation on the plurality ofbiological subjects in the image obtained by the image capturing at thesecond time point, the analyzing unit analyzes the image correspondingto each of the biological subjects received by the input unit, andextracts the feature amount about the biological subject at the secondtime point, and the specifying unit corrects the parameter based on thefeature amount at the second time point, and in the image including theplurality of biological subjects obtained by the image capturing at athird time point later than the second time point, the specifying unitspecifies the recommended biological subject based on the correctedparameter.

With the image capturing system, at the second time point, if there is adiscrepancy between the recommended biological subject and the selectionrecord of the biological subject by the operator, the feature amount isextracted again (feature amount is learned), and the parameter iscorrected based on the feature amount. Then, at the third time point,the recommended biological subject is specified based on the correctedparameter. Therefore, in the selection operation at the third time pointand thereafter, the accuracy of specifying the recommended biologicalsubject can be further improved. That is, in parallel with theoperator's selection operation, the accuracy of specifying therecommended biological subject can be gradually improved based on thelearning effect of the feature amount.

Preferably, the image capturing system further includes a mode changingunit configured to change an operation mode to treat the recommendedbiological subject specified by the specifying unit as the biologicalsubject for which the selection operation is received by the input unitwithout receiving the selection operation.

With the image capturing system, the selection operation by the operatorcan be omitted when the mode changing unit changes the operation mode.It is assumed that, as the learning of the feature amount progresses,the accuracy of specifying the recommended biological subject increasesto such an extent that intervention of the operator's selectionoperation is no longer required. At such timing, the work of selectingthe biological subject can be completely automated by causing the modechanging unit to change the operation mode.

In the image capturing system, the feature amount may be a featureamount based on a shape of each of the biological subjects.

The image capturing system may further include a plate including aplurality of compartments configured to accommodate the biologicalsubjects, wherein the image capturing device captures a state where thebiological subjects are accommodated in the compartments of the plate,and the feature amount is a feature amount based on an amount of each ofthe biological subjects accommodated in one of the compartments. In thiscase, the amount of each of the biological subjects may be an amountobtained from at least one of a number, an area, and estimated volumeestimated from a contour of the biological subject.

Alternatively, the feature amount may be a feature amount based on acolor of each of the biological subjects, and the feature amount may bea feature amount based on a pattern of each of the biological subjects.

Furthermore, the feature amount may be a feature amount based on lightintensity in a region of each of the biological subjects on the image.Alternatively, the feature amount may be a feature amount based on thelight intensity of the region of each of the biological subjects and aperipheral region on the image.

Preferably, the image capturing system further includes: a plateincluding a plurality of compartments configured to accommodate thebiological subjects; a head having a tip that picks up each of thebiological subjects from each of the compartments of the plate, the headbeing capable of transferring the picked up biological subject; and acontrol unit configured to control an operation of the pickup by thetip, wherein the image capturing device captures an image of a state inwhich the biological subjects are accommodated in the compartments ofthe plate, and the control unit performs control to cause the tip topick up each of the biological subjects to which the selection operationis given by the input unit or each of the biological subjects to whichthe selection operation is not given.

The image capturing system can have a function of picking up thebiological subject to which the selection operation is given or is notgiven, and transferring the biological subject to a desired position.

In the image capturing system, when a plurality of operators arepresent, the specifying unit preferably specifies the recommendedbiological subject individually for each of the operators based on alearning result of the feature amount according to a selection result ofeach of the operators. This makes it possible to specify the individualrecommended biological subject based on selection tendency of eachoperator, rather than the average recommended biological subject for allthe operators.

In the image capturing system, when a plurality of types of biologicalsubject exist, the specifying unit preferably specifies the recommendedbiological subject individually for each of the biological subjectsbased on a learning result of the feature amount according to aselection result of the operator on each of the biological subjects.This makes it possible to specify the recommended biological subjectaccording to the type of biological subject, rather than the averagerecommended biological subject for all the biological subjects.

In the image capturing system, when an identical type of biologicalsubject collected from a plurality of individuals exists, the specifyingunit preferably specifies the recommended biological subjectindividually for each of the individuals based on a learning result ofthe feature amount according to a selection result of the operator onthe biological subject of each of the individuals. This makes itpossible to specify the recommended biological subject according to eachindividual, even for the identical type of biological subject.

The present disclosure described above can provide the image capturingsystem that can accurately select the biological subject and reduce thelabor of work for selecting the biological subject.

What is claimed is:
 1. An image capturing system comprising: an imagecapturing device configured to simultaneously capture an image of aplurality of biological subjects; a display configured to display theimage including the plurality of biological subjects captured by theimage capturing device; an input configured to receive input from anoperator regarding a selection operation on the plurality of biologicalsubjects displayed on the display; an analyzer configured to analyze theimage corresponding to each of the biological subjects to which theselection operation is given by the input and extract a feature amountabout the biological subject; and a specifying unit configured to set aparameter that defines a range of each of the biological subjects to beselected based on the feature amount extracted by the analyzer for eachof the biological subjects to which the selection operation is given upto a first time point or a reference feature amount determined inadvance, the specifying unit being configured to specify a recommendedbiological subject on which the operator is prompted to make a selectionbased on the parameter in the image including the plurality ofbiological subjects obtained by image capturing at a second time pointlater than the first time point, wherein when the input receives inputof the selection operation of each of the biological subjects that doesnot agree with the recommended biological subject specified by thespecifying unit in the selection operation on the plurality ofbiological subjects in the image obtained by the image capturing at thesecond time point, the analyzer analyzes the image corresponding to eachof the biological subjects received by the input, and extracts thefeature amount about the biological subject at the second time point,and the specifying unit corrects the parameter based on the featureamount at the second time point, and in the image including theplurality of biological subjects obtained by the image capturing at athird time point later than the second time point, the specifying unitspecifies the recommended biological subject based on the correctedparameter.
 2. The image capturing system according to claim 1, furthercomprising a mode changing unit configured to change an operation modeto treat the recommended biological subject specified by the specifyingunit as the biological subject for which the selection operation isreceived by the input without receiving the selection operation.
 3. Theimage capturing system according to claim 2, further comprising: a plateincluding a plurality of compartments configured to accommodate thebiological subjects; a head having a tip configured to pick up each ofthe biological subjects from each of the compartments of the plate, thehead being configured to transfer the picked up biological subject; anda controller configured to control an operation of the pickup by thetip, wherein the image capturing device captures an image of a state inwhich the biological subjects are accommodated in the compartments ofthe plate, and the controller is configured to cause the tip to pick upeach of the biological subjects to which the selection operation isgiven by the input unit or each of the biological subjects to which theselection operation is not given.
 4. The image capturing systemaccording to claim 1, wherein the feature amount is a feature amountbased on a shape of each of the biological subjects.
 5. The imagecapturing system according to claim 1, wherein the feature amount is afeature amount based on a color of each of the biological subjects. 6.The image capturing system according to claim 1, wherein the featureamount is a feature amount based on a pattern of each of the biologicalsubjects.
 7. The image capturing system according to claim 1, whereinthe feature amount is a feature amount based on light intensity in aregion of each of the biological subjects on the still image.
 8. Theimage capturing system according to claim 7, wherein the feature amountis a feature amount based on the light intensity of the region of eachof the biological subjects and a peripheral region on the still image.9. The image capturing system according to claim 1, further comprising:a plate including a plurality of compartments configured to accommodatethe biological subjects; a head having a tip configured to pick up eachof the biological subjects from each of the compartments of the plate,the head being configured to transfer the picked up biological subject;and a controller configured to control an operation of the pickup by thetip, wherein the image capturing device captures an image of a state inwhich the biological subjects are accommodated in the compartments ofthe plate, and the controller is configured to cause the tip to pick upeach of the biological subjects to which the selection operation isgiven by the input unit or each of the biological subjects to which theselection operation is not given.
 10. The image capturing systemaccording to claim 1, wherein the feature amount is a feature amountbased on a shape of each of the biological subjects.
 11. The imagecapturing system according to claim 1, further comprising a plateincluding a plurality of compartments configured to accommodate thebiological subjects, wherein the image capturing device captures a statewhere the biological subjects are accommodated in the compartments ofthe plate, and the feature amount is a feature amount based on an amountof each of the biological subjects accommodated in one of thecompartments.
 12. The image capturing system according to claim 1,wherein the feature amount is a feature amount based on a color of eachof the biological subjects.
 13. The image capturing system according toclaim 1, wherein the feature amount is a feature amount based on apattern of each of the biological subjects.
 14. The image capturingsystem according to claim 1, An image capturing system comprising: animage capturing device configured to simultaneously capture a stillimage of a plurality of biological subjects; a display configured todisplay the still image including the plurality of biological subjectscaptured by the image capturing device; an input configured to receiveinput from an operator regarding a selection operation on the pluralityof biological subjects displayed on the display; an analyzer configuredto analyze the still image corresponding to each of the biologicalsubjects to which the selection operation is given by the input andextract a feature amount about the biological subject; a specifying unitconfigured to set a parameter that defines a range of each of thebiological subjects to be selected based on the feature amount extractedby the analyzer for each of the biological subjects to which theselection operation is given up to a first time point or a referencefeature amount determined in advance, the specifying unit beingconfigured to specify a recommended biological subject on which theoperator is prompted to make a selection based on the parameter in thestill image including the plurality of biological subjects obtained byimage capturing at a second time point later than the first time point;and a plate including a plurality of compartments configured toaccommodate the biological subjects, wherein the image capturing devicecaptures a state where the biological subjects are accommodated in thecompartments of the plate, and the feature amount is a feature amountbased on an amount of each of the biological subjects accommodated inone of the compartments.
 15. The image capturing system according toclaim 14, wherein the amount of each of the biological subjects is anamount obtained from at least one of a number, an area, and estimatedvolume estimated from a contour of the biological subject.
 16. An imagecapturing system comprising: an image capturing device configured tosimultaneously capture an image of a plurality of biological subjects; adisplay configured to display the image including the plurality ofbiological subjects captured by the image capturing device; an inputconfigured to receive input from an operator regarding a selectionoperation on the plurality of biological subjects displayed on thedisplay; an analyzer configured to analyze the image corresponding toeach of the biological subjects to which the selection operation isgiven by the input and extract a feature amount about the biologicalsubject; and a specifying unit configured to set a parameter thatdefines a range of each of the biological subjects to be selected basedon the feature amount extracted by the analyzer for each of thebiological subjects to which the selection operation is given up to afirst time point or a reference feature amount determined in advance,the specifying unit being configured to specify a recommended biologicalsubject on which the operator is prompted to make a selection based onthe parameter in the image including the plurality of biologicalsubjects obtained by image capturing at a second time point later thanthe first time point, further comprising: a plate including a pluralityof compartments configured to accommodate the biological subjects; ahead having a tip configured to pick up each of the biological subjectsfrom each of the compartments of the plate, the head being configured totransfer the picked up biological subject; and a controller configuredto control an operation of the pickup by the tip, wherein the imagecapturing device captures an image of a state in which the biologicalsubjects are accommodated in the compartments of the plate, and thecontroller is configured to cause the tip to pick up each of thebiological subjects to which the selection operation is given by theinput or each of the biological subjects to which the selectionoperation is not given.
 17. The image capturing system according toclaim 16, wherein when a plurality of operators are present, thespecifying unit specifies the recommended biological subjectindividually for each of the operators based on a learning result of thefeature amount according to a selection result of each of the operators.18. The image capturing system according to claim 16, wherein when aplurality of types of biological subject exist, the specifying unitspecifies the recommended biological subject individually for each ofthe biological subjects based on a learning result of the feature amountaccording to a selection result of the operator on each of thebiological subjects.
 19. The image capturing system according to claim16, wherein when an identical type of biological subject collected froma plurality of individuals exists, the specifying unit specifies therecommended biological subject individually for each of the individualsbased on a learning result of the feature amount according to aselection result of the operator on the biological subject of each ofthe individuals.